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ABSTRACT 



Aims. Several authors have claimed to detect a significant cross-correlation between microwave WMAP anisotropies and the SDSS 
galaxy distribution. We repeat these analyses to determine the different cross-correlation uncertainties caused by re-sampling er- 
rors and field-to-field fluctuations. The first type of error concerns overlapping sky regions, while the second type concerns non- 
overlapping sky regions. 

Methods. To measure the re-sampling errors, we use bootstrap and jack-knife techniques. For the field-to-field fluctuations, we use 
three methods: 1) evaluation of the dispersion in the cross-correlation when correlating separated regions of WMAP with the original 
region of SDSS; 2) use of mock Monte Carlo WMAP maps; 3) a new method (developed in this article), which measures the error as 
a function of the integral of the product of the self-correlations for each map. 

Results. The average cross-correlation for b > 30 deg. is significantly stronger than the re-sampling errors — both the jack-knife and 
bootstrap techniques provide similar results — but it is of the order of the field-to-field fluctuations. This is confirmed by the cross- 
correlation between anisotropies and galaxies in more than the half of the sample being null within re-sampling errors. 
Conclusions. Re-sampling methods underestimate the errors. Field-to-field fluctuations dominate the detected signals. The ratio of 
signal to re-sampling errors is larger than unity in a way that strongly depends on the selected sky region. We therefore conclude that 
there is no evidence yet of a significant detection of the integrated Sachs-Wolfe (ISW) effect. Hence, the value of Q A » 0.8 obtained 
by the authors who assumed they were observing the ISW effect would appear to have originated from noise analysis. 

Key words, cosmic microwave background - large scale structure of Universe 



1. Introduction 



Several author s (iFosalba et al. 2003b IVielva et al.~2 006: 
I Cabre et al 200l iRaccanelli et al. 2008t iHo et al. 2008: 
iGranett et al. 20 08) have claimed that there is a significant 
cross-correlation between cosmic microwave background 
radiation (CMBR) anisotropies and the density of galaxies, 
which is interpreted as the integrated Sachs-Wolfe (ISW) 
effect. An anticorrelation caused by the Sunyaev-Zel'dovich 
effect would also be expected on scales smaller than ~ 1°, 
but this is negligible when averaging large regi ons of the sky 
dHernandez-Monteagudo & Rubino-Martfn 20041) . The con- 
clusion of these authors is that the measured cross-correlation 
should be interpreted as a detection of the ISW effect within a 
ACDM-cosmology and it serves to constrain the value of the 
cosmological parameters. 

We reanalyze whether this correlation exists by considering 
galaxies observed by the Sloan Digital Sky Survey (SDSS), tak- 
ing particular care in the calculation of the cross-correlation er- 
rors. The root mean square (r.m.s.) of the cross-correlation for 
distant, widely different areas of sky (here called "field-to-field" 
errors) infer much larger errors than those calculated using re- 
sampling cross-correlations techniques i.e., when these are de- 
termined in different strongly overlapping and thus not indepen- 
dent subsamples of a given sample (re-sampling errors). We con- 
clude that measurements of the errors in the cross-correlation 
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function for overlapping sub-fields lead to an underestimate of 
the true scatter in the signal. 



2. Data 

We consider two types of data for the two fields that we cross- 
correlate: 

1 . Microwave temp erature anisotropies ( 6T) from the 5th year 
WMAP release dHinshaw et al. 20091) . We use the V-band 
(61 GHz) data because of its lower level of pixel noise. We 
checked that the results of this paper are approximately sim- 
ilar if we use the W-band (94 GHz) data. There is no need to 
subtract foreground Galactic contamination because this is 
not correlated with galaxy counts (corrected for extinction), 
and because this is small in off-plane regions. In any case, the 
publis hed foreground correct ions might not be enough accu- 
rate dLopez-Corredoira 2007b . We assign the same weight to 
each WMAP pixel of equal size. 

2. Galaxy counts (G) are obtained from the survey SDSS, pho - 
tometric catalog, data release DR7 ( Abazaiian et al. 2009). 
They cover an area 11,663 deg 2 (28% of the sky) mostly in 
the northern Galactic hemisphere. We did not use the striped 
region data with b < 30° to ensure low Galactic extinc- 
tion and avoided negative latitudes because these are small 
isolated regions dominated by edge effects. We used only 
galaxies with r magnitudes in the range [18,21] (Galactic- 
extinction corrected) (within these limits galaxy counts are 
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complete) and "clean photometry" according to an SDSS al- 
gorithm (e.g., we removed sources close to saturated objects 
with contamination of their by other objects), and avoiding 
the borders by ~ 0.3 deg. In this situation, the total used area 
is 7,349 deg 2 (18% of the sky), containing 2.2, 6.4 and 17.1 
million galaxies in the r magnitude ranges [18,19], [19,20], 
and [20,21], respectively. 



3. Methods 

By defining the galaxy count (G) density contrast to be Sc(9) = 
(G(ff) - (G))I{G), and denoting by S T {9) = T(9) - T the fluctu- 
ations in the CMBR with respect to the average temperature To, 
the cross-correlation function can be written as 



u TG {0) = <<5r(0)<5c(O)>. 



(1) 



The estimator of Eq. ([]]) computes the cross-correlation to be the 
average over all pixels with separations 9 + (A9/2), where A6 is 
the step between successive values of 0. In what follows, we set 
A8 » 0.29 deg. 

There are two kinds of errors in the cross-correlation, associ- 
ated with two distin ct ways of constructing su b-fields over which 
they are computed dSvlos Labini et aL2 009): 

1 . Re-sampling errors: for point distributions, there is a compo- 
nent of the total error that is caused by the finiteness of the 
number of points and i s closely related to tha t given by the re- 
sampling techniques dBetancort-Riio 19911) : however, here, 
in the correlation of two continuous fields, the association is 
not at all clear. These may be estimated with a re-sampling 
technique, for instance jack-knife or bootstrap. In the latter 
case, we calculate n s times the cross-correlation by removing 
each time a different fraction l/n s of the N pixels. By using 
the bootstrap method, we also calculate a number n s of times 
the cross-correlation that each time chooses the same num- 
ber N of pixels from the original sample, but randomly se- 
lected (so that there are some pixels that are selected several 
times, while others are not selected at all). Both in bootstrap 
and jack-knife, we then calculate the r.m.s. of these n s re- 
samplings, which provides our error. We use n s - 10, which 
implies that the relative error in the r.m.s. is (2n s y 1 ^ 2 ~ 20% 
for Gaussian errors. We note that for both techniques the 
n s determination have been performed on overlapping sub- 
samples, and they are thus not independent. 

2. Field-to-field fluctuations: these are caused by intrinsic fluc- 
tuations in both the large-scale structure of galaxies and the 
microwave temperature field. We propose three methods for 
estimating these fluctuations: 

(a) Different fields: We cross-correlate the G field in the 
full area with a different field ST* of the same power 
spectrum as the original WMAP data, although uncorre- 
cted with G. One simple way of applying this method 
is assigning to ST* the value of its own WMAP data 
but in other regions of the sky that are completely sep- 
arated. For instance, we define ST*(l, b) = ST (I + /3, —b) 
with different values of /3 (we consider n s = 10 dif- 
ferent values: f3 = 2in/n s , z'=l to n s ), and calculate 
the r.m.s. for the n s realizations. In this case, we use 
a small enough number (n s ) of regions, so the rela- 
tive error in the r.m.s. is (2n s y 1/2 -20% for Gaussian 
errors. The cross-correlations at scales 60-180° might 
produce some signal, but this would be small, given 
that the self-correlation of ST is almost zero for 9 > 




8 (degrees) 

Fig. 1. Log-log of the self-correlations of the fields Sc and St- 



60° dCopi et al. 20091) . The possible large-scale cross- 
correlations of the different fields infer that this esti- 
mation of the r.m.s. value is a conservative upper-limit 
value. 

(b) Monte Carlo simulations of WMAP: We generate a num- 
ber of Monte Carlo realizations of WMAP by using 
the software "synfast" to generate random mock maps 
of anisotropies corresponding to the theoretical power 
spectrum (Hinshaw et al. 2009) filtered for the V-band. 
We perform ns = 100 realizations, and then calculate 
the r.m.s. of their cross-correlation with the fixed SDSS 
galaxy counts map. The relative error in the r.m.s. is 
(2n s )- 1/2 = 7%. 

(c) Integral of the self-correlations: A calculation of the 
field-to-field variance in the cross-correlation of two non- 
correlated fields can be given by (see Appendix jAl 

°i TG (Q) = 2<w rr (f3 1 , 2 )w GC (f3 3>4 )>4, 9 , (2) 
where ((.. 0)4.0 stands for the average extended over all 
groups of four pixels (1,2,3,4) in a region in which the 
separation between pixels 1,3 and 2,4 is between 0-A0/2 
and 9 + A9/2, #1.2 is the separation of pixels 1,2, #3 4 is 
the separation of pixels 3,4, and ojjt and u>cc are the 
self-correlations, respectively, for the fields St and Sc- 
We note that with this method we assume that St and Sc 
are uncorrelated (as in Monte Carlo simulations); there- 
fore, cr refers to the limits of pure non-correlated fields 
within the corresponding probabilities (68%). In addi- 
tion, we note that we use the self-correlations that we 
measure in our fields (see Fig. [O, i.e., we have only one 
realization. Cosmic variance would introduce some extra 
uncertainty. 

4. Results 

In Fig.[Tj we plot the self-correlations. In Fig. [2] we show the de- 
termination of the cross-correlation function for different ranges 
of magnitude, and the errors computed by using re-sampling er- 
rors and field-to-field determinations. On the one hand, the er- 
rors computed by both the bootstrap and the jack-knife method 
are of the same order, and on the other hand the three "field- 
to-field" methods yield similar results, which however are much 
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Fig. 2. Cross-correlation function ojjg WMAP-SDSS (black line) for galaxies with b < 30° and in the magnitude range 18 < r < 19 
(left panel), 19 < r < 20 (center panel), and 20 < r < 21 (right panel). The rms value calculated by resampling errors and field-to- 
field fluctuations are also plotted. 



larger than the re-sampling errors. The "Different fields" method 
yields in general a slightly lower r.m.s. than the integral of the 
self-correlations, possibly because of small positive large-scale 
correlations, which slightly reduce the dispersion, as mentioned 
in discussing "different fields" in |3] The "Monte Carlo" method 
might yield slightly higher values of r.m.s. than the integral 
of the self-correlations due to the larger amplitude of the low- 
multipoles in the theoretical power spectrum. 

The field-to-field fluctuations obtained by using independent 
determinations of the cross-correlation function are similar to 
the amplitude of the detected signal or even larger. Figure [3] il- 
lustrates this point by showing that there are no positive average 
cross-correlations in a sky region of area more than half of the 
full angular coverage. 

From all these analyses, we cannot exclude the value of \cjtg\ 
being compatible with zero for any 6 within field-to-field fluc- 
tuations. Thus we conclude that there is no significant cross- 
correlation detection. This situation is similar to that found for 
the SDSS 3D self-correlation by Sylos-Labini et al. (2009), who 
also demonstrated that the field-to-field fluctuations are of the 
order of the signal in the previously announced discovery of 
baryon acoustic oscillations and large-scale anticorrelations. 



WMAP-5 vs. SDSS-DR7, 20<r<21 



total area, b>30 : 7,349 deg 
lll<108°, b>30°: 3,906 deg 2 
i°<lll<180°,b>30°: 3,457 deg 2 




Fig. 3. Cross-con-elation (cj tc ) WMAP-SDSS, 20 < r < 21: the 
average of the whole selected SDSS-DR7 area, and the average 
for |/| < 108° and 108° < |/| < 180°; error bars represent jack- 
knife re-sampling errors. 



5. Comparison with previous works 

Other authors who calculated the cross-correlation between 
WMAP and SDSS galaxy counts measured a significant signal. 
For instance, Cabre et al. (2006) measured a value of u>tgO°) ~ 
0.5 //K and a significant positive u>tg f° r all angles lower than 20 
degrees for the subsample 20 < r < 21 over 5500 square degrees 
of SDSS-DR4. Giannantonio et al. (2008) obtained a value of 
w rc (3°) ~ 0.3 yuK for the subsample 18 < r < 21 of SDSS-DR6, 
excluding the southern Galactic hemisphere and high Galactic 
extinction regions. In addition, they found a significant positive 
signal out to 9 — 8 degrees. Their values are more or less compat- 
ible with our estimate of the cross-correlation function, within 
the re-sampling error bars and taking into account that their sub- 
samples are slightly different. However we do not measure sig- 
nificant cross-correlations, whereas these author do a result we 
cannot explain. 



Cabre et al. (2006) and Giannantonio et al. (2008) performed 
Monte Carlo simulations using mock maps, and obtained simi- 
lar values or ones only slightly larger than a jack-knife. We do 
not know whether these disagreement are caused by mistakes in 
their calculations or whether their claim is that re-sampling er- 
rors represent the full errors. Other authors used only jack-knife 
technique errors (e.g., Sawangwit et al. 2009). A similar problem 
may affect the results of Raccanelli et al. (2008), who measured 
the cross-correlation between NVSS radio sources and WMAP 
anisotropies. Raccanelli et al. (2008) calculate the error in sim- 
ulating 1,000 mock NVSS maps by randomly distributing the 
unmasked pixels of the true NVSS maps. We are concerned that 
this process might destroy part of the self-correlation of each 
map, and that the errors might not represent the full field-to-field 
fluctuat ions. There has been considerable discussi on of these 
errors (ICabre e t al. 2007} iGiannantonio et al. 200 8). However, 
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against their claims one can infer from the analyses of this pa- 
per that: i) jack-knife or bootstrap methods do not calculate the 
whole error; ii) the level field-to-field fluctuations is as large as 
the measured average signal. In addition, our conclusion is that 
the signal is largely dependent on the specific sub-region cho- 
sen. We find that in the large area of |/| < 108°, b > 30° (3,906 
square degrees available with SDSS-DR7, more than half of the 
sample) we do not measure any signal, so the average signal of 
the entire sample must be caused by a fluctuation. 

One remarkable aspect of the analysis of WMAP/SDSS- 
DR4 is that Cabre et al. (2006) obtain a 3.6<x detection for 
20 < r < 21, while Giannantonio et al. (2008) with a wider areal 
coverage (SDSS-DR6) and broader range of magnitudes, 18 < 
r < 21, achieve only a 2.3<x detection. This decrease in the sig- 
nificance is unexpected if the signal were real. We also note that 
some authors calculated the combined signal to noise ratio of 
different cross-correlations in different samp les, obtaining val - 
ues over4cr, by summing them quadratically (ICabre et al 2 006). 
This is incorrect because they do not take into account the cor- 
relation between the samples, thus neglect an important part of 
the estimated error. 

A higher significance in the c ross-correlation of 
WMAP/SDSS is claimed to be obtained dGranett et al. 20081) 
when only super-clusters/super- voids are correlated with 
WMAP instead of the entire SDSS survey: a value of 4.4cr. 
Apart from our questions raised above, we are also concerned 
about possible a posteriori fitted parameters used to obtain this 
correlation. For instance, Granett et al. (2008) separate regions 
of the sky centered on super-clusters with radii of 4 degrees; we 
ask why 4 degrees? These authors illustrate that the significance 
is only 3.5cr for radius 3 deg or 3.8cr for 5 deg. The significance 
also changes with the number of superclusters/supervoids 
selected, being 4.4cr with N - 50 but only 2.8<x with N = 70. 
A signal to noise ratio of 2-3<x is provided by other authors 
without any selection of super-clusters, so they appear to have 
considered both a radius and number of superclusters/supervoids 
that achieves the maximum increase in the signal to noise ratio 
(from 2-3 up to to 4.4). 

We note that Bielby et al. (2009) measured the correlation of 
WMAP anisotropies with emission-line galaxies selected photo- 
metrically from SDSS and inferred a non-significant correlation, 
with large field-to-field errors comparable to those we obtain 
(we are cautious in interpreting their result, however, because 
the cross-correlation in the different subfields are not indepen- 
dent and this affects the way in which they have been using to 
determine the r.m.s.). They claim that their result implies that 
possibly emission line galaxies are more strongly clustered and 
less correlated with microwave anisotropies, something that is 
not entirely clear to us. In our opinion, the results of Bielby et al. 
(2009) of non-significant cross-correlation may be correct and 
there is unlikely to be a difference in the interaction of galaxies 
with the background CMBR that is caused entirely by them hav- 
ing emission lines. Sawangwit et al. (2009) failed to measure a 
significant cross-correlation between the luminous red galaxies 
of SDSS-DR5 and WMAP. On the other hand, they found some 
positive correlation of WMAP with 2SLAQ survey, and nega- 
tive correlation of WMAP with the AAOmega survey. Analyses 
by Hernandez-Monteagudo (2008) demonstrated that the cross- 
correlation of WMAP/SDSS-DR4 should have at least within a 
signal/noise ratio of 0.7-1.7, much lower than the significance 
obtained by the authors cited above. These results might be in- 
terpreted as independent confirmations of our results here. 

Apart from those analyzing data from SDSS, previous stud- 
ies reach the general conclusion that the ISW effect was not de- 



tected significantly in: (1) cross-correlations with X-ray XRB, 
Boughn & Crittenden (2003) claiming an absence of the ISW 
using X-ray data; (2) near-infrared 2MASS, Francis & Peacock 
(2009) not finding any corresponding ISW signal; or (3) radio 
sources NVSS, Hernandez-Monteagudo (2009) casting doubt on 
the correlation between WMAP and NVSS radio sources, since 
the cumulative signal to noise ratio of the cross-correlation with 
multipoles / < 60 is lower than 1, and the ISW itself, since the 
signal to noise ratio should be around 5 theoretically. 

6. Conclusions 

We concluded that there is no significant cross-correlation be- 
tween the CMBR temperature anisotropies of WMAP and the 
galaxy counts of the SDSS, and any claims to have detected 
the ISW effect on the basis of significant cross-correlation are 
unjustified. Field-to-field fluctuations dominate the detected sig- 
nals. Any detection of signal is very dependent on the selected 
region of the sky. Other authors erroneously claimed to have de- 
tect significant correlations because they had used a particular 
sky region with a fluctuation that is not representative of the av- 
erage sky or because they had underestimated the statistical er- 
rors by using non-independentre-samplings. If our conclusion is 
correct, the value of £2a ~ 0.8 obtained by those authors based 
on the assumption of observing the ISW effect would have been 
one induced by noise. Its value would be coincident with the ex- 
pected value for ACDM by chance, and in the spirit of accepting 
a scientific result when it indeed produces numbers expected a 
priori. 
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Appendix A: Field-to-field errors in the 
cross-correlation as an integral of the 
self-correlations for two uncorrelated fields 

□ 

We consider two continuous random scalar fields, Fa and F B , in a space 
with d dimensions and any topology. Without loss of generality, we shall as- 
sume that the mean values (over realization) of both fields is zero and they are 
not correlated: (Fa) = (Fb) = (FaFb) = 0. On the other hand, the values of 
each field at two different points Xu X2 are not independent random variables: 
^aib(x\,xt) = (Fa/b(xi)Fa/b(x2)), where the average is over realizations. In 
practice, in most interesting cases the fields are statistically homogeneous and 
ergodic, so that ai depends only on X[ -X2, and the correlation may be defined as 
spatial averages, which is the useful definition since in most cases only one re- 
alization is available. If the fields are also statistically isotropic, at depends only 
on r = \x\ -x%\. For the following derivation, we shall assume homogeneity and 
isotropy; the full expression might easily be recovered if needed. 

We first derive the "field-to-field error" (i.e., the true error) for the zero lag 
estimator: 



B when any new global realization of both fields is carried out. In the case when 
we fix the realization of one of the fields while changing the other, Eq. jA.7t is 
also valid but the self-correlation of the fixed realization must be calculated by 
averaging over pixels in this fixed realization, rather than over realizations. Now, 
since the estimated self-correlation may fluctuate above and below the universal 
(mean of all realizations) value, it is clear that the variance in the estimator of 
the cross-correlation of A and B when one of them is kept fixed may be slightly 
above or below the one corresponding to the case when both fields fluctuate. 



1 

E[cj AB (r = 0)] = - Yj FA(i)F B (i) 



(A.l) 



where Fa/ b (i) = Faib(xC)- We have replaced the rf-dimensional volume integral 
over the sample with a sum over N equal volume cell indexed by i and centered 
on x,. We would have to multiply the contribution of the field for each pixel by 
a weight equal to the volume of the pixel in the case of non-equal volume cells. 
For the variance in Eq. jA.lt , we have: 



: 0) = (E 1 ) - (Ef 



■ (E 1 ), 



(A.2) 



since, by construction, the mean value of E over realizations, u>ab, is assumed to 
be zero. Developing the square of expression )A. IK and taking its average, we 
have: 



<£2> = M \E FA(i)F B (i)F A (J)F B (j) 



In principle, the factor of 2 should not be there in the case i 
negligible in the limit of arbitrarily small cells. 

Now, since the fields Fa and F B are uncorrelated 



(A.3) 

: j, but this will be 



(F A (i)F B (i)F A U)F B (j)) = (F A (.i)F A (f)KF B (i)F B U)) = ^(r,,)^,,), (A.4) 
where ry = \xj - Xj\. Thus, we have 



< AR (r = Q) = 2(0J A {r)0J B (r)). 



4f f 

V s J J sample 



io A (r\2)OJ B (r\2)d d r i d d r2, (A.5) 



where V s represents the volume of the sample. 

The correlation estimator for any non-zero lag is 

1 N 

E[oj AB (r )] = —j J] F A (i)F B (j), 

'.j/rij=r 



(A.6) 



where ro — Ar/2 < r < ro + Ar/2. Following Eq. iA.6i using the same procedure 
as for Eq. )A. It . one obtains 

(T li AB ( r o) = 2<WA(ri2)w B (r 3 4)>4.,. = 



2/1 



<*>A (n 2 )<^ B (i"34 )d d r i d d T2 d d ri d d 



''4 



'sample / r\ 3 =r,/"24 =f 



d d rid d r2d d r 3 d d r4 



(A.7) 



Equation IA.7K and its particular case, Eq. {A3), infer the variance over 
realizations of the estimator of the correlation between two uncorrelated fields A, 



1 By J. Betancort-Rijo. 



